Information-theoretic approach to unimodal density estimation

نویسندگان

  • Patrick L. Brockett
  • Abraham Charnes
  • Kwang H. Paick
چکیده

Ex = (I + y / t) (l +. r y / : ') El0 = (1 + ! / / Z) (l + .r2y/:3) all R-multiples of Es. The error positions in this case are (j. 1. l) , In general, when decoding an error relative to an algebraic geometric code C*(D. 7rtP), there is a vector space S (g) l of error-locator functions of dimension Z(m)-e. Most algorithms settle for any element of this space as an error-locator and deal with extraneous zeros later. If one considers the ideal Z of all error-locator functions, then there is a generating set of size at most p, the smallest positive pole size at P. The one-dimensional BerlekampMassey version of the Feng-Rao algorithm given here is sufficient to reasonably efficiently produce such a generating set, and the error positions (for any error of weight at most c < i6:t, S " *, = m-29 + 2, the designed distance of the code) will be exactly the common zeros L'(2) of those error-locator functions. (For further efficiency, " higher dimensional " BerlekampMassey algorithms can be worked out in a straightforward manner as well.) This Feng-Rao type algorithm gives the designed distance independent of the Riemann-Roch theorem, and the algorithm to get these is merely row-reduction with shifting (as with any BerlekampMassey type algorithm), coupled with a Feng-Rao majority-vote scheme to produce further syndromes. Moreover, such a strategy can be used on arbitrary divisors (5 (though at present it is not provable that one can achieve decoding up to the designed distance efficiently in this manner). The generating set found may, in addition, allow for efficient calculation of the common zeros. So the algorithm given here has the advantages that 1) it treats all projective points, 2) it decodes up to the designed minimum distance, 3) it uses a (one-dimensional) Berlekamp-Massey row-reduction algorithm to efficiently (that is with roughly what should be expected as a running time) row-reduce S , 4) it produces a small set of generators for the whole error-locator ideal Z, rather than settling for a single error-locator function with possibly extraneous zeros. (A minimal Grobner basis can be extracted from this or produced directly from a BerlekampMassey type row-reduction algorithm that treats rows of the syndrome matrix as grids generated by the minimal nonzero elements of C(@). and shifts in all the grid directions.) Decoding algebraic-geometric codes up to …

منابع مشابه

Information Theoretic Clustering using Kernel Density Estimation

In recent years, information-theoretic clustering algorithms have been proposed which assign data points to clusters so as to maximize the mutual information between cluster labels and data [1, 2]. Using mutual information for clustering has several attractive properties: it is flexible enough to fit complex patterns in the data, and allows for a principled approach to clustering without assumi...

متن کامل

Combination of real options and game-theoretic approach in investment analysis

Investments in technology create a large amount of capital investments by major companies. Assessing such investment projects is identified as critical to the efficient assignment of resources. Viewing investment projects as real options, this paper expands a method for assessing technology investment decisions in the linkage existence of uncertainty and competition. It combines the game-theore...

متن کامل

Probability Density Estimation using Isocontours and Isosurfaces: Application to Information Theoretic Image Registration

We present a new, geometric approach for determining the probability density of the intensity values in an image. We drop the notion of an image as a set of discrete pixels, and assume a piecewise-continuous representation. The probability density can then be regarded as being proportional to the area between two nearby isocontours of the image surface. Our paper extends this idea to joint dens...

متن کامل

An Information Theoretic Approach to Flexible Stochastic Frontier Models

Parametric stochastic frontier models have a long history in applied production economics, but the class of tractible parametric models is relatively small. Consequently, researchers have recently considered non–parametric alternatives such as kernel density estimators, functional approximations, and data envelopment analysis (DEA). The purpose of this paper is to present an information theoret...

متن کامل

An Information-Theoretic Approach to Distributed State Estimation

It is shown that the covariance intersection fusion rule, widely used in the context of distributed estimation, has a nice information-theoretic interpretation in terms of consensus on the Kullback-Leibler average of Gaussian probability density functions (PDFs). Based on this observation, a novel distributed state estimator based on the consensus among local posterior PDFs is proposed and its ...

متن کامل

MDL Histogram Density Estimation

We regard histogram density estimation as a model selection problem. Our approach is based on the information-theoretic minimum description length (MDL) principle, which can be applied for tasks such as data clustering, density estimation, image denoising and model selection in general. MDLbased model selection is formalized via the normalized maximum likelihood (NML) distribution, which has se...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

متن کامل
عنوان ژورنال:
  • IEEE Trans. Information Theory

دوره 41  شماره 

صفحات  -

تاریخ انتشار 1995